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iiSSTRi^CT 


In this thesis yre make a modest attempt to explore the possibility 
of using an established method of proving properties of programs, viz., 
The Fixpoint Theory of Computation, to prove results concerning the Time 
Complexity of a restricted class of programs written in an iSLGCL-lika 
language. This attempt nay be viewed as a case for uniformity of study 
of various properties of programs. 
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lUTRODUCTION 

The Pixpoint Theoiy of Computation of Scott (Scott 70) is used 
to define the Semantics of Computer Programs in terms of the least 
fixpoint of recursive transformations of the state (a name~value 
mappling). This allows not only the justification of all existing 
verification t6ohniq.ues, hut also their extension to the handliig 
in a uniform manner, of various properties of computer programs, 
including correctness, termination and equivalence (Manna 74)* 

The study of Computational Complexity of Programs (Aho 74) > 
of the important properties of programs, is not yet handled through The 
Pixpoint Theory, It is studied as a separate field. Thus, there is 
no uniformity of approach in the study of important properties of 
programs, 

A possihilil^ that can he suggested for applying the fixpoint 
theory to the study of computational complexity arises from the 
manner in which the function APPLY is defined in LISP (McCarthy 60)* 

APPLY ; LP m — 5^ETP 

where LP is a LISP function, 

AL is a list of arguments, 

SETP is the set of values to which LISP functions 
reduce, 

APPLY gives the semantics of LISP functions. The suggestion 
here is, can we analogously define: 

TCOMPLEXITY s P X TP“ X P^— -> G 

SCOMPLEXITY s P X Sp“ X PS^ -■-? H 


1 
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wher e 

P is a computable function, 

PS is a characterization of problem size, 

IP is a set of primitive funotions in terms of which P is 
recursively defined and which are considered as signi- 
ficant with respect to the assessnont of time complexity, 

SP is a set of primitive data units in terms of which we wish 
to assess space-complexity, 

G s TP“^ X PS^ S'R™, 

H t SP^ X PS^ — ~>R^ 

R is the set of real numbers 

and. 'rcOHPLEXITT and, RCOLPLSXITY are functions that respectively stand 
for Time and Space complexity of P with respect to PS and the 
corresponding primitives TP and SP. 

The motivation for this suggestion is that we try to throw away 
in 

all information/the program that is irrelevant as far as the study of 
computational complexity goes. This done, we would have, as a result 
a simple function which, in essence, counts. Appreciating the bounds 
on the value of the counters, one for each primitive function or data 
vmit is tantamount to appreciating the complexity of the original 
function. 

A possible track for effecting the above reduction is to build a 
library of typical counting functions and proofs of their bounds sepa- 
rately. This activity need be done only once, of course. The library 
can then be effectively used for obtaining the . bounds of the resultant 
G and H respectively. 
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0?he alDove approach is indeed a long range one. In this thesis, 
we make a modest attempt, as a beginning, in the above view, for a 
restricted class of simple programs. ??or such a class of programs P, 
we try to formulate the transformation to a class of recursively 
specified programs P*, such that the number of computations needed in 
P’ is identical to that of P. then apply The Pixpoint Theory to 
find out the oompleExity of P’. 

1.1 OUTLIKE OF THE THESIS 

To understand Ihe Pixpoint Theory we will require many important 
mathematical terms. We survey these briefly in this chapter., in the 
next section. 

Chapter 2 gives a brief introduction to The Pixpoint Theory of 
Computation. Scott's approach is based on the following central ideas 

"The functions computed by Recursive Programs are the least 
fixpoints ofnCQotonio and continuous transformations that they represent". 

Scott's construction of the least fixpoint of a program T as the 
least upper bound of the sequence of functions I^(w) is considered in 
this chapter. 

In Chapter 3 it is shown how high level language (iLGQL-iike) 
programs can be translated in to recursive programs of the forms 
F(x) 4=^ T(p)(x)» 

Chapter 4 contains an application of The Fixpoint Theory, to a 
restricted class of programs, to find their complexity. 
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1.2 BASICS 

Vfe shall consider n-ary partial fimctions (n 0 , integer) 
from a domain = I)_^XD 2 X ... X into rang§ D'l that is, for every 
n-typle a = ..., a^) 6 I) 5 either f(a) is defined (i.e., 

f (a) 6 B*) or it is undefined. 

A 0-ary partial function is a function with n arguments yielding 
either a constant value or is "undefined". 

Vfe shall include n-ary partial predicates p(x) as a special 
case "because they are partial functions from B^ to B' = I true,false3 . 

In developing a theory for handling partial functions it is conve- 
nient to introduce the special element w to represent the value "unde- 
fined", Thus if f(a) is undefined, we write f(a) = w. 

Since we shall consider composition of fxnctions, v;e may need to 
j^ompute functions with some arguments "being w. 

Lf.b us taJce B^ = B^ U and 

^ bl 

then partial functions from B^ to B* are total functions £com B^ to 
B' . So extension of functions from B^ into B’ to B^ into B' assures 
the possibility of composition* 

We will use w to stand for 

(a) the single undefined element w 

(b) the undefined vector (w,w, ..., w) 

or (c) function w which is undefined for all domain elements. 
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Depending upon the context the appropriate use of w will he 
unajnhiguousl ;7 understood (Manna 74)» 

Definition 1.2.1 COMPOSETIOIT 

Let f s d“ — :^D' and g ; D* J^D” (D" = D" D ju? ) 

then composite of g and f, denoted hy gpf, is defined hy 

g,f(5) = g(f(i ))5 1 - 5 e d” . 

(For the composition gof "domain of g equal to range of f"' is not 
necessary but the range of f should be the subset of domain of g») 
Definition 1.2.2 EDLE OF CQMPIJTillOIT 

Given a composite function gof> the order of evaluation is caUsd 
a rule of computation. For instance gof(x:) can be evaluated by the 
following two sequences: 

Let f (x) = y then 

one sequence is (l) y = f(x) 

then (2) g(y), 

inother sequence is obtained by substituting f(x) for y throughout 
the specification of g. 

In the first Sequence, the computation of f(x) is done only once, 
whereas in the second sequence, f(x) is computed wherever the value 
of y is required in the specification of g. 

Definition 1.2.5 PARTIALLY OaPBRED SET .(poset) 

A poset is a set D in which a binary relation Q is defined* which 
satisfies for all x,y,z B D the following conditions: 
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(a) jc c X foi all X (£ D (Heflexive) 

(Td) If X c y anri y q x then x = y (Antisymmetiy) 

(c) If X ^ y and y z then x c z Cffianaitivity) 

Definition 1.2.4 CHAIN 

A posot D mth respect to C is said to be a chain (or totally 
ordered or linearly ordered) if for all xjy € D either x C y or y c; x. 
i.e.. all elements of D are comparable* 

Definition 1.2.5 A CHAIN IH POSESC 

Let D bo a posot, K a non-empty subset of D and t' the restriction 
of g to K, 

g « = cn (K X K) 

i.e., for x,y K, x y if and only if x C y« 

If K \'ri.th respect to is a chain, we say that K is a chain 

in D. 

Definition 1»2»6 B0I3EDS 

Let D be a po^t and K C D. An element d € D is aaid to be .an 

upper bound (u.b) of K if for e'very x ^ K, x C d. 

Note that a subset K C D may have more than one u.b. in D or me^ 
have no u.b. in D. 

t 

An element 1 C D is said to be the least upper bound (lub) of K C D 

if it is the least element of all upper bounds of K in D. That is, it 

satisfies 

(a) for all x £ K, x c 1 
and (b) for any u.b# d ^ D of K, 1 C d 
This lub is denoted by U K* 
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If K = » Xgj •••» ^5 shall Trait e 

n 

^ ~ i if K = Xgj •••> 3C^j • * *_5 

then 

cC 

K = Li X. . 

i=1 ^ 


Definition 1.2.7 A CIIAIII-CLOSBD SEP 

A pos et D is said to he chain-closed if each chain in D has a 


luh. 


It is Tery easy to vexify that 

(a) a subset of a chain is itself a chain. 

(b) oaoh finite chain has a lub. 

Definition 1.2.3 

Let f be a function with a domain D and x € D. Pox any n £ N 
(the set of non-negative integexs), wo define the notation f^(x) as 
follows : 

(a) f“(x) = X 


(b) ^^(x) = f(f^(x))| n - 5 : 0 , 

A fixpoint of f is an element x fc D fox T/hich f(x) = x. 

Ihen the set of all fixpoint s of f has a least element, this 
element is called the least fixpoint of f. 

Definition 1.2.9 MOHOTOmCITY ' 

Let D^ and D^ be two posets Trath C and as lelations xespectively 

Then a function f s D^ ^D^ is said to benmoton-ioif fox all x,y » 

X ^ y implies f(x) Cl' f(y)* 





8 


I'Toiv let us take an example which virill help in understanding all 
these terms. In the following chapters we vi/ill use the same order 
relation over the set of functions and notations which axe given in 
the example helovr: 

Example s Let S he the set of all partial functions ftaDi I* to L". 
Define g. on B as follows? 

For any f ,g £ S, 

f C g if either f(x) = vr or 

f(x) = y then g(x) = y| (y j/ w) 

i.e», Tivhenever f is defined at xj g is also defined at x and they have 
the same value at x. 

So note that w £■ f for any f if S. 

One can easily verify that S is aposet. 

Let T he a function ficm S — S (i.e., T is a functional). 

T is monotonic if and only if 

T(f) T(g) whenever f c g. 

If T is a monotonic functional then since 
w (w) , T (w) c; ^ V T (-w) = w) 

(w) = 'r(T (w)) T(T^(w)) (*.* T is monotonic) 

- 

Kius T^(w) E T^(w). % applying T to this TO get T^(^) c T^(b) 


and so on 
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* . Tfe have 

T°(vO C t''(w) C T^(w) C .... t Q C ... 

?hus 

^ T^(w) ; i 1:5, 0 integer I is a chain in S. 

If S is a chain-closed set, it has a luh T (v) in s 

(Loeckx 74) . 
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THE FIXPOIIT 'THEORY 

2.1 FimMimHHL VIEt7 OF PROGRAIE 

A progiam P descuiTaes an action, usually called a oommand oi 
statement. As we look within this piogiam we find this gioss command 
to be a composition of simpler commands. 

vi/hat is a command? A command changes the state of the store (memory). 
That is, 

a oommand (statement) is a mapping of initial state to a final 
state. 

A State S of the store can be described by the contents of locations, 
i.e., it gives values of the locations. So we can view a state as a 
function from names (locations) to values. 

Thus, if L is the set of locations and 
T is the set of values then 
S ; L -'-—i'Yt 

One may think of the state as consisting of all variables (names 
manipulated by the program) and their respective values. , 

Thus we see that a statement is a nothing but a function of function 
i.e., a functional. 

In other words, 

A Comnuter Program is a functional . 

2.2 RECURSIVE PROGRAMS 

A Recursive Program is a lisp-like definition of the form 
T(x) T(f)(i) 

where T is a functional, T(P) is a fxinction. 


10 
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T(f) is a composition of 13338 functions (like assignmont, addition, 
sulstn action etc.) and the function •vaiia'ble F, applied to the individual 
vaiiaUles x = (x,y,z, ...)« 

For example, sho-vvn helow, is a recursive program over the inte- 
gers. 

Pj^ ! F(x) If ot ah Oi^then 1 else F(x-1 ) . 

Note that it is undefined for negative integers (does not terminate 
for negative integecs), so it is a partial function. 

We allow our base functions to he partial because they represent 
the result of some computation "which ney, in general, give results for 
some inputs and run indefinitely for others. 

As limiting cases of partial functions we include the nowhere 
defined function w and everywhere defined functions, called total funo-. 
tions. 

Br ample t The statement 

L * GO TO 1 has undefined effect for all state vectors • ** 

For any n 0 and given domains D* and P" (where D* may be 

X X X P )• let us denote the set of ell functions 
12 n'^ ' 

f i D* •= — ^P" and predicates over D’ 

+ 4 * 

as * Fun ^. , Fun includes nowhere definedrfunotion w also. 

In the sequel n is an integer, n Of F or f denotes a function 
variable ranging over Fun , i.e., F.f gFun s x denotes a variable ranging 
over P *5 T is a function, T t Fun — »- Fun . 
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On every extended domain = DTJ^wJ we define the partial 
ordering in the following way (Manna 74)* 
for x,y £ 

X C y if and only if either x = w or x = y. 

Note that distinct elements of are imrelated hy t and 
w c X for all X 0 D_^« 

For (D )” = N X D X ... X N we define 

(x^jXg, ...» 2^) Q (y^> y2» y^) 

if and only if C y^^ eaah. i, 1 ^ i •C n« 

If f is xinary fimction from !)_• to we define f(w) = w. 

If f . is n-ary (n 2) function froit Dj to I” we define 

f(xj » Xjj *•»» Xjj) = w if at least one x^^ is w. 

Thus all our "basic functions (i.e» memhers of Fun.) are monotonic. 

2.5 ORDERING 

The a-TTn of this chapter is to prove that if F is recursively 
defined ly T(f) then F is the lu'b of ^ j integer ^ » 



15 


oO / 

i.e. , P(x) T(p)(x) then P = | f T^(w). 

i=0 

A key question to this end iss To which ordei relation, does this 
luh correspond? 

Let us define the partial ordering (relation) C on Pun< the set 
of functions, as helows 
Lefiriition 2.5 «1 

Let f, g € Pun then f c g if and onily if either f(x) = w 

or f (x) == y=^ g(x) = y 

where y w. 

i.e., wherever f is defined, g is also defined and both give the same 
value for that argument. 

Examples 

(a) For any function f £ Pun, w g f. 

(b) Let D* = I X I and D" = I (l isliieset of all integers). 

Define f ^ , ^2 € as follows: 

f-j (x,y) = X y then x + 1 else y - 1 

f 2 (x,y) = ^ (x > y) and (x-y even) then x + 1 else w. 

We see that for ar^ pair of integers (x,y) such that f^Cxjy) is 
defined, f^(x,y) is also defined and have the same value, x + 1. 

Thus fg t f^. ** 

Definition 2.5.2 Syntax for T(P) 

The syntax of a functional T is defined as follows: 

T(p) is either 
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(i) a "base function 

(ii) P 

(iii) constiucted from already given f^(P), T(P) lay 
(a) composition s (F)oT 2(^) 

("b) selection s 

If P(5) then T^(P)(x) else 
or (iv) Constructed from already given 

T^(p), T^(P) (m 1) and given m-varialle base function 

b giving 

bo(T^(P), 

E.g., P(x) «^:I£ X = 0 then 1 else x * P(x-1) defined over integers. 

We can see that T(p) is constructed from many functions t f(x) =* I5 
g(x) « x-1| base function b(x,y) = x * yi predicate p(x) = (x = O), all 
according to the syntax given in the definition. 

Theorem 2.1 

Let T(p) be givoi as in Definition 2.5.2 then T is a monotonic 
functional, i.e., for any that ^ ^ 

Proof 

Let us prove it by induction caa the structure of T. 

(i) If T(f) = base function f 

i.e., T(f) (x) = y if f(x) = y 
or T(P) = P then it is obvious. 

(ii) Let T(P) = T^(P)oT2(P) where T^ and Tg monotonio. (induction 
hypothesis) . 
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= y "then by definition of composition, 

there exists z such that 

T2(I'^)(x) = z and (F^|z) = y. 

Now c fg so by induction hypothesis, 

T^(F^) e T^(F2) and ^ T^Cf^) 

•* TgCF^) (x) = z ==> ^ 

and T^(P^)(z) = y T^(F2)(z)=y. 

T^(F2)oT 2(F2)(5) = y, 

/. tCp^) = y 

Thus T(F^)(x) =y =~> 1(^2) (x) =y 

T(Fp C T(P2) 

.*. T is monotonic* 

The remaining cases can be amoved similarly* ** 

2.4 THE FIXPOIM? theorem: 

Now let us see how the least fixpoint of a transformaticn T is 
obtained*' 

We know that w f for any function f in Fun . Now consider the 
seq.uence 

w, t"^(w), T^(w), T^(w), .*. 

Since T is monotonic, 

w Qt''(w) i.e., T°(w) G T^(w) T(T°(w)) ^= T(t'* ( w)) 

t''(w) C T^(w) 



16 


O -T 

igain applying T, we get T‘^(w) t T^(w) and so on. 

*1 ^ 

So w C T (w)c .... T (w) C. ... 

0 integer j is a chain in Pun . 

But Fun is a chain-closed set (see(Loeck3c 1A)§ ox (llanna 74 )) 

So ^ T^(w) % 1':^ 0 integer ^has a luh T^(w). 

In this section we shall prove that ^ T^(w) is a least fixpoint 

i=0 

of a transformation T, 

But for that we need to prove that T is a continuous function. 
Definition 2.4.1 CONUIIDIIT 

Suppose that M is a chain-closed set. The function f defined on 
M is said to he continuous if for any chain Z M 
(i) f(K) has a luh 
(ii) f(UK) = U f(K). 

Note that, hy rearranging the elements, if necessary, in any chain 
K = £ f^l of, functions in Fan. K can be re\'raitten as f 3 such that 
f rr f for every d 0. ilLso T is monotonic, so we can sea that 

i ~ i+1 

T(K) is also a chain. And Fun being a chain-closed set, T(k) has a 
luh. So to prove the continuity of T we have to prove that for any chain 
of functions ^fj_^ , T(LJ{f^? ) = U [,^(^i)5 * 

Theorem 2.2 

Any functional T defined as in Definition 2.3*2 is continuous. 

Proof 

We prove the theorem hy induction on the structure of T. 

The details of the proof are given in (Bakker 75 )• 
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Theorem 2.^ 

Let P be declared by P(x)4=; T(p)( 3E) where T is defined as in 

^ _i 

Definition 2.3.2, then ^('w) is the least fixpoint of T. 


Proof 


i=0 


oC. 

Since T is monotonic function. ^ „ is a chain in Pun. 

ry) » 1 \ 1-Q 

U T^(w) exists. 

i=0 

let 

0<2 

U T^(w) = P 
i=0 ^ 


So 


(i) Pm is a fixpoint of T 

CJO 

T(Pm) = T ( U t'^Cw)) 
^ i=0 


= U T(T^(w)) 
i=0 

= L_1 (vr) t= 

i=0 


('.* T is continuous) 


oO . cvO , 

U T^(w) = ( Li T^(w))U w 
j=1 j=1 


U T^(w) 


j=0 


(ii) Pj is the least fixpoint. 

Suppose that a function f is any fixpoint of T. i.e., T(f) = f. 
¥e have to prove that P^ C f. 

'By induction on i, we prove that T^(w) C f for any non-negative 


integer i. 
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Pox i = 0, T^(w) = r°(w) = w ;• W ^ f =?^T°(w) f. 
Suppose for i = j, T^(w) C f holds. T^(w) c f 

Now 

T^^''(w) = T(T^(tO) 

tT(f) (***T^('w)t f and 1 is monotonic) 

. = f 

!r^’^*'(w) c f 

Thus T^ (w) t f => (w) c f 

T^(x 7 ) tf for every integer i':;5,0. 

. . f is an upper hound of (w) j 
oo . 

U T^(w) & f (2.4-1) 

i=0 


Thus for any fixpoint f , P^ C. f . 

Pj is the least fixpoint of T. 

2*5 SEJ O'IICS OP L RECURSIVB PHOGR/AI 

In this section we shall shovT that if a function P is recursively 
defined hy 

p(x) -4=^ t(p) (x) 


then P can he found hy the least fixpoint of 
In fact. 


P = 


Li T (w) 

i=0 


T. 


Theorem 2.4 


cc 


Let P(x) T(P) (x) then P ~ Li ^ (™‘) • 

i=0 

(^ntax of T is as in Definition 2.5.2). 
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Proof 

<3C‘ 

Ve have to justify (i) \J T^(w) C P 

i=0 

and (ii) PC ij !r^(w) 
i=0 

(i) T(p)(x) So P is a fioced point of T (Bakkor 75A). 

So from the result (2.4.I) we have 

•.sO . 

LJ T {w) U F. 

i=0 

(ii) We have to prove that if p(x) is defined, say P(x) = y then 

oO . 

( LJ T^(w))(x) = y 

i=0 

P(x) is defined. How P(x) is determined? Lot us look at the v^ay 
in which the programmer determines P(x). 

He/She determines T(p)(x). For this, he/she may call P again i.e., 
T(P) is substituted in place of P, 

Since P(x) is defined, this calling process must come to an end. 
i.e., there exists an 3 ::^1.suoh that T^(p)(x) = y and in the applica- 
tion of T^(P) to the given x, p is not encountered anymore. 

/nd so, we may replace F in 0?*'(P) everywhere by w. 
i.e.. For this x, we can write 

y = T^(P)(5) = F^(w)(x) 

ir^(w)(x) = y for every i ^ 0 and j is finite. 

How T^(w) is the limit of the sequence (w) | (Scott 70), so above 

i«0 

result implies 
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( 1..i T^(w))(x) = y 


i»0 


F C 


oo 

u 

i=0 




** 


Thus the eemantics of a reouisive piogram can he defined as; 

"The function defined hy a necucsive prognam F^^ T(f) is the least 

fixpoint of T, viz., \_J OT^w)." 

i=0 

2.6 Exaigple 

Considei the lecucsive piogcam oven the set of non-negative inte— 


geis. 

F(x)^ If X = 0 then 1 else x * F(x-1). 

Here T(f)(x) = If x = 0 then 1 else.x^F(x-l). 

T°('w) = w. 

t"^ (w) (x) = X =■ 0 then 1 else x * w(x-1 ) 

« ^ X = 0 then 1 else w. 

Thus t'^(w) is defined only foi x = 0 and its value foi x = 0 is 1» 

T^ (w) (x) » ( T( T^ (vr) ) ) (x) 

« T(t'^(w)(x)) 

= If X = 0 then 1 else x T (w) (x-1 ) 

s= ^ X = 0 then 1 else x ^ (if x-1 = 0 then 1 else w) 

Thus T^(w) is defined only fon x = 0,1. 

And l^(w)(0)>,1» . T^(w)(l) =1. 

T^(w)(x) = If, X = 0 then 1 elee 

X * X = 1 then 1 else 

(x-1) * (If X » 2 tljen 1 
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For A > 2, T^(w) is undefined. 

iind T^(w)(0) = T^(w)(l) = 1 , T^(w)(2) = 2 * (2-1 ) * 1 

= 2 

In general, 

(u) (x) = ^ X '^'5 then x J else -w. 

• • L.J (w) = ® where Pm(x) = x J for e'Very integer x ^ 0. 
i=0 ^ 

** 

To avoid confusion with a rocursive definition of P we shall 
denote f | T^(w) by P™ instead of P, in the following chapters. 

i-0 ^ 


I 


Ql-N I > i • i ! IBfcAltIf 

ta-N.. A 

' " * ' 1 *”^ 



CHAPTER 3 


TRAHSEOEI.IATION OP ALGOL-LIKE PROGRAMS TO ESCMSI7E 

PROGRAMS 

The scope of this chaptei is the specification of transformation 
rules that will enable the rewriting of programs written in ALGOL-like 
languages to Recursive Programs as described in Section 2.2. The pur- 
pose of this transformation is to be able to apply the theory available 
for studying properties of Recursive Programs to the study of time 
complexity of simple program? written in practical languages which is 
the subject matter of Chapter 4» 

The sole guiding principle for the transformation of ALGOL— likn 
programs P to Recursive Programs P* is that (Manna 72) 

(i) the partial functions computed respectively by both 
programs are identicali and 

(ii) the transformation preserves the time complexity 
properties of P* 

The featur§a of ALGOL that we consider are very simple indeed | 
there iSj however, no theoretical difficulty in extending them. The 
language we consider has* (E is an expression} B, B^ are blocks 
or elementary statements) 

(1) Assignment statements* x^ *= e(x) where x = (x^, .••» ^jj) 

(2) Seq.uential composition* B^ * B^ 

(3) Conditional composition* 

(i) ® 

(ii) If p(x) then B^ else Bg 
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(4) Iterative compositions while p(x) ^ B 

( 5 ) Procedural abstractions 

(i) non recursive procedures; 

Procedure P| B 
(ii) recursive procedures: 

Procedure P j Bfpj 

As a major restriction, whose impact will be seen only in Chapter 
4, we consider only those programs in which iterative statanents as 
well as control of recursion are effected by Boolean conditions concern- 
ing a relationship bet^veen a single variable (which is modified within 
the enclosed block) and other constants (that is, either literals 
or variables which are not modified by any constituent command within 
the enclosed block), 

3-1 RULES OF TlMSFOmiATION 

!Ihe rules of transformation, described in the following subsections, 
are based on the description of the ALGOL-like subset above. The trans- 
form d:ion is defined blookwisetto each block B (or elementary statement) 
we associate a partial function f^ computed by it, 

Por example: 

begin x:= x-2:| y:= y+1| z:=z-1 end , 
will be represented by the function 

f(x,y,z) = (x-2, y+1, z-1), 

3*1.1 Assignment Statements 
If B Is x:= b(x) then 

fg(x) = (x^, Xg, E(x), x^^^, .*•, 2{^) 
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where 

= (x^ j Xgj •••» ^i+1 * •**> ^1]) 

Note, as a result, that side effects in expressions are disallowed. 
3 * 1*2 Sequential Composition 

If B = 5 B^ then fg(x) = f^ (f^ (2c) )• Tinder the rule of computation 

• 2 1 ' 

that B^ is performed "before B^, we assert that, 

fgi^x) = fg (y) where y = 

5*1.3 Conditional Composition 

5.1 .5*1 For .the case B = If p(x) then B^ | 

fg( 3 c) = If p(x) then f^ (x) else x* 

Note that the Boolean condition p on x is side-effect free. 

3.1.3 * 2 For the second case 

S =■ 1 £ p(x) then B.^ else Bgj 

fg(x) = If p(x) then f^ (x) else f^ (x) . 

1 2 

5 . 1.4 Iterative Composition 
B ■= while p(x) B^ 

than f^(x) is the least fixpoint of the recursive program 
i5 

F(x) 4 =. If p(x) then F(fg (x)) else x. 

1 

5.1 .5 Procedures 

Here we have two cases j non-reoursive procedures and repursive 
procedures. We will deal with each in turn. 

3. 1.5.1 Non— recur sive Procedures . Consider the declaration 


Procedure Pj B^ 
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wheie P is the name of the pzocedijies and 

B is its body. Intuitively, we see that 

is executed on call. Ihis is what we wish to formalizes 
B = Call P then 


^B ^call P^^^ ” 

5*1*5*2 Recursive Procedures ; Consider now the declaration 
Procedure Pj 

where P is the name of the procedure j and 

B^ £p3is..a block in which there is a recursive call to P. 
^Call least fixpoint of the recursive program 

VJhero J occucBcncos of Call P will be replaced by P in the aematic 


definition f^ 

Example t 

Consider the program P vhioh computes x J 

for given non-negative integer x. 

P t begin y s=1 1 

while x^ 0 do 

begin ys= y*x| 
xs=x-1 

end 


end . 

The partial function computed by P is identical to the least 

fixpoint of p‘ where 

P‘ « g(x)4= p(x,1) 

P(x,y) ^ — If X > 0 then P(x-1 , y^) 

else (x,y). 



CHAPTER 4 


APPLICATION OP THE PIXPOIHT THECEY TO STUDY TIME- 
COMPLEXITY OP PROGRAJK 

4.1 TII4B-C0MPLEa:TY MD THE STRUCTURE OP PHOGRi'JJS 

In this section, we will exploie the lelation between Time- 
Complexity C^ and the stmcture of the ALGOL-like subsets we 
have chosen in the previous chapter. Oui interest is in worst case 
analysis, i,e», we are interested in upper bounds. Complexity is 
given in terms of input variable x, so for a block B with input x 
we shall denote its complexity by Cj(B)(x). 

4-1 .1 A.ssignment Statements 

C^ for assignment statements entirely aris® from the time 
complexity of expression evaluation. Since v/e have not considered 
functions as a pact of the subset we can expect the value of C^, 

to be a constant. We will express this as: 

Cj( assignment statement)® = 0(l) where x is an input. 

4.1.2 Seauantial Composition 

The f'ormula for for sequential ccmposition B^i Bg is straight- 
forward. 

Bj)® = + OjCBjIy) 

where 

y = f B ®. 

4.1.3 nnwiitional Conroosition 

EOT the two oases, we have oonsiderea tn the laagaage, the 
assi«n«eht of 0^ is etfai«htforwOTd for this fern of oompoeitior also 
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(i) C5, (If p(x) ^ B^) (x) = Cj(B^)(x) 

(ii) Cj (If p(x) thOT B^ ^B2)(5) = 0(Cj(B^)(x)) + 0(C^(B2 )(x)) 

4*1 *4 Iterative Conroosition 

B : while p(x) do B^ * 

This is the first case where the use of The Fixpoint Theory comes 
in. 4s can be noted the number of times the iteration is performed is 
determined by the successive .values of the variable being tested, in 
the controlling predicate p(x), hereafter called the controlling variable 
(roc^l a restriction placed on Controlling predicates in Chapter 5)* 

Thus if x^ is a control variable, where x = (x^jXgf^j x^, ^c^)® 

and Xj £ Bj, then we are interested in ^finding the time complexity of 
B * while p(x^) do B^. 

The function that gives the next value of the control variable is 
denoted by g in the rest of this chapter. 

4. 1.4.1 A Method ? For the iterative composition, 

B t while p(xp ^ 
the equivalent recursive program is 
P(x)4== T^(f)(x) 

where 

T,(P)(x) = If p(x.) then F(f (x)) .glse x. 

•• “ C|j(Fj)(x) • 

Partition in to two parts BJj and B^' such that B* captures only 
that part of which deals with the computation of the next value of 
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controllinj variable x. and captures that part of B^ which pertains 
to the remaining body of the loop. 

Then 

= Cj(G^)( 5) * Cj(B!p(5) 

where 

G(x)4=If p(x.) then G(f^,('x')') else x. 

a ^1 

and X has as components x^ and all other variables (components) in x 
on which the next value of x. is dependent. 

.. T(G)(x) = pCxj) then G(f^,(3c)) else x . 

J 

For any x, the maximum number of conditions (predicate) to be 
checked to compute T^(w)(x) is i. So 0^,(1^ (w)) = 0(i). Ihis C^, is 
in terms of integer i which corresponds to the superscript of T. It 
is indirectly concern ed with input x. 

For any given x, i.e., x^, there exists such that T^(w)(x) 

gives the value of G^(x). For this x, T^(x) is defined for every k ^ i 
but the same number of computations, i, are needed, (if G-^(x) is defined). 

Cy(GgXx) « Ojp(Cj(Gf(w))^ where 0 ^(T'(w)) is related v/ith input x^. 

To find the ccmplexity of G^ in terms of x^ we have to relate i with 
Xij say a relation i = h(x.). 

To find h, one clue we have is the nature of change of x^ for each 
iteration. This can be arrived at from the relation betv/een T^(w) and 
T^'*’'^(w)| T^'^'’(w) * T(T^(w)). 
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In B * , X. is changed to g(x.). So the value of x. vfhich ioqxa.a:es 

V cl » 

maximum numbei_of iterations, i.e», i iterations, computed, over T^(w) is 
such that p(g* holds (i.e., p(g^(xp) holds for every n^l) 

hut p(g^(x.)) does not hold. 

u 

In general, there may he more than one value x. satisfying this 

0 

condition. Let us denote the set of these values hy S^, i.e.f 
=« / p(g^”'*(xp) and not p(gi(xp) 

So 

D. = U s^-'- 

^ i=1 

Intuitively, is that subset of D. such that for its members 

J 

i iterations are necessiated in the computation of the function 
represented hy the while loop. 

How we pick an element e^ of such that , ' 

i. i.— i 

(i) g(e ) = e for every i 2 
and (ii) there exists a function r s H — ^D. 

(N is a sat of positive integers) for which 
r(i) = e^ and r is one-to-one. 

-j 

That is g(r(i)) = r(i-l). This Idads us to the solution h = r . 

Cj(G^)(x) = 0(r“'^(x^)). 

4.1 .5 Procedure 

For the two oases, we considered in the language, the assignment of 


Cj is straightforward* 
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(i) Non-secursive Pioceduies 
Prooeduie P| B 

Heio conplexity csm "be given By; 

C,j(p)(x) = 0 j(b)(x). 

(ii) Recursive Piocedme; 

PaiooeduiQ Pj B [jp] . 

Complexiiy foxraula can Be given ass 


0j(p)(3 - pC) 

v/heis f nn -r, is the least Jixpoint of the leouisive- program 
calx ir 

p(x)^^ fg j.p^(x)j where occurrences of call P will Be replaced By P 
in the semantic definition 

So long as constraints on the variable controlling recursion are 


similar to those imposed on iterative compositions, viz*, while loops. 


a technique similar to the one proposed in oan Be used. 


4.2 EXiI.gLE5 
Example 1 

Consider the program P to find the factorial x 1 for given non- 
negative integer x 1 * 

Ps y i=* 1| 

while X > 0 ^ 

Begin y»= y*x5 
xs= x-t 

end; 

C^(p)(x,y) » Cj(y t= l)(x,y) + Cj(B)(x,y) 

vrhore B is the while loop. 

C^(B)(x,y) « 0^(Y y*x)(x,y) * Cj(B^)(x) 
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whole Cg,(B^)(x) =s C|j,(P^)(x) and P^ is the least fixpoint of 
P(x)4=: T(P)(x)| 

where T{f){x) = ^ x > 0 then P(x-l) else x. 
g(x) = x-1. 

Now T^(w) = w 

i A 

T (w) (x) ^ X > 0 then t (w) (x-1 ) else x 

“ 2 C > 0 then w else x 

A A 

T (w) (x) « X > 0 then (w) (x-1 ) else x 

a If X > 0 then ( If (x-1 ) > 0 then w else (x-1 ) ) 
else x« 

.. Sg = |l| . 

1 1.1 

S has only one element so no other choice of e . e =0 

o i p 2 

iUso g(6 ) « Q 6 « 0 +.,1 =5 1 which is an element of S • 

i i— 1 

From the violation g(e ) == e \ 

1 i ^ i-1 

we have e -I® e 

1 • • i 

G « 0 •’# By induction, we get e = i - 1. 

Take E(i) = i-1 for every i:^1. 

r is one-to-one. 

C^(Fj)(x) a 0(r‘*\x)) 

a 0(x+l) 

a 0(x) . 

Thus 

Cg,(P)(x,y) - 0(1) + 0(1) * o(x) 
a 0(l) + 0(x) 
a 0(x). 
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Bicainple 2 

Consider the hlock B ^vhere m and n are non-negative integers, 

B * n > 1 ^ Begin m j= nj 

n i- n-1| 

while m > 1 ^ m := m div 2 

ondj 

Here C^(B)(n,ni) » C^(BJj) (n) * Cj(B»)(n,m) 


where 


B! « while n>1 do n s« n-1 
1 — 

B" t- m t= n; while m > 1 do m := m div 2 
C^(B^')(n,m) = 0(1) + 0^(0^) (n). 


where G{ia)^-If n >1 then G (h div 2) el^ m. 
Now from Example 1, Cy(B^)(n). = 0(n). 

To find^l^m)* 

T(G)(m) » If m> 1 then G (m div 2) else m 

/. g(ra) « m div 2. 

Now t’’ (w)(m) « I£ Q > 1 then w else m 


T^(w)(m) «= M n > 1 then Tl(w) (m div 2) else m 

« If m> 1 then ( If (m div 2) > 1 w 


(m 


div 2) ) 


^ -|2i- 
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If WG take e =0 then g(e^) = e"^ implies = 0. But 0 ^ S^l 

also x(l) = 0, 2 (2) = 0 
« 

..2 does not "become one— to— one. 

.. .ve take e =1. ilso e"' = 1 = 2 which is in s^. 

.• By induction ^2021 g(e^) « e^ we get unique = 2^”^ P02 ¥i>1. 

Note that e = 1 6 s'* } = 2 and g is oue-to-one| so 

got hy g(e ) » e "by induction fox evexy i > 1, is in s^. 

Take 2(i) m 2^ 2 is one-to-one* 

•• “ 0(2 ^(n)) 

= 0(log2n + 1) 

= oClog^n). 

Thus 

Oj(B)(n,m) = 0(n) * (0(l) + oCloggn)) 

« 0(n) * ©(log^n) 
o 0(n loggn) 

H02Qafte2 the "base of log is taken as 2| if it is not mentioned . explidi 
Ebcampla 3 

Considsn the following pnognam of Heapsont which 2ea22anges n 

nunbexs A(l), A(2), •*., A(n) in increasing order. 

Procedure HEAPSORT(A,n) 

"begin Sail m£IFI (A,n) 5 
i t«n5 

while i 2 ^ begin t := A(i) | A(i) j= A(t ) | 

4i) s= 

Qall ADJUST (A,1,i-l)5 
i i-1 
end 

end . 
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Fioceduie HEiJPIPY (A,n) 

/ /Re ad just s the elements in A(l|n) to form a Heap.// 
begin i := n div 2 ; 

while i > 0 ^ begin Call ADJTJS!r(A,i,n) 5 

i s= i -1 
end 

end . 

Procedure ADJUST (A,i,n) 

//The complete binary trees with roots A(2i) and A(2i+1) are combined, 
with A(i) to form a single heap, 1 4 i ^V/ 


begin j := 2 * if item := A(i )5 

while 0 4-^^ begin If j < n and A(;3) < A( j+1 ) then ^ t- a+1 1 

If item A(j) then exit 

else begin A( { j/2j ) = A(j); 
3 j *2 
end 

/ • / k 22 ^ 

A(\_V2,9 *= item 
end * 

C^(HEJPSOET)(A,n) = 0^(HE/iPIFr)(A,n) + 0(l) + C^(B)(A,n) 
where B is the while loop in the procedure HEAPSCRT. Breaking B into parts, 


we see that 

C^(B)(A,n) « C^(lO(n) * (0(l) + Cj(ADJUST)(ik,1 ,n-1 )) 

where 


B* : while i > 1 ^ i s= i-1 • 

Cj(B*)(n) « 0(n). 

To find 0^(/J)JUST)(A,i,n)j 

We note that in the while loop j is either changed to j+1 then 


j = 3*2 or 3 = 3*2 without becoming 3+1. In the latter case more 
iterations are necessiated. Also we assume that item A( 3 ), for eveiy 
3, so that as many as possible iterations are executed. This we do because 
we are finding worst case complexity. 
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• • The while loop in iiDJTIST is equivalsni "to 
Tjjfaile 3 4 n ^ 3 := 3*2, 

r. 0j(iJ3JDST)(A,i,n) = 0 ( 1 ) + Cj(G^)(2i,n) + 0(l). 


whene 


G'(3»w) = 3 4- ^ then 3 = 3 *2 else 3* 

Hone g(j) a j * 2. 

THw)(3,n) = If 3^ ^ then w else 3 

•• “ £3 / 3 > nj 


T‘^(w)(3»n) « If 


3 4;” then I lf (3*2) 4 ^ then w . 

\ else 3*2 I 

else 3* ■■ * 


= £ 3/3 > 


P -f 2 

Take el = n+1 then g (e ) = e‘ implies e = (n+l)/2 which. is in 
S^, Also g is one-to-one. So we get unique e^ which is (n+1 )/2^ ^ » fox Ti>1 . 
x{x) B foi every i ^5, 1. 

Cj(G^)(3,n), » 0 (x”’’(3)) 


0 (log^(^) + 1 ) 


C^(G^)(2i,n) = 0(log(^) + 1) 

C^(A3>JUST)(A,i,n) » 0(log(|^) + I) 

How. Cj(HEi![PIFr)(A,n) = 0^(1 *= n div 2)(A,n) 

+ C^(Hj)(n div 2) * Cj(ADJUST)(A,n div 2,n) 


H(i) « If i > 0 then H(i-l) else i. 
C^(Hy)(i) - 0(i). 


where 
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= 0(1) + 0(n div 2) * o(log(^) +1) 

= 0(1) + o(n) * 0(1) (V n 1) 

= o(s) 

Cj(HB;peOM)(A,n) 

= 0(13) +0(1) + 0(n) * Cj(iDJTJST) (a, 1,13-1) 

= 0(13) +0(1) + o(n) * 0 (log^ ”-~p— ■ ) 

= 0(13) +0(1) + 0(13) * O(lo^) 

= 0(13) + 0(1) + 0(13 log 13) 

= 0(l3 log 13 ) 

Example A 

We will now see how to apply the fixpoint theory to fi33d the 
oomplcncity of simple programs having data structure other than integers. 

Our data domain should he ordered with a suitable ordering relation. 

For most of data d.omainsj if we impose t on order relation on the given 
domain stuoh that there exists a funotiomi. L from this domain to the 
set of integers such that it idtiu itafr preserves order relation 

imposed on the domain, then we apply the fixpoint theory. 

In that case, in place of data elements x of a given domain, we can 
substitute the corresponding value L(x) and can find the complexity hy . 
the fixpoint theory. As an illustration* 

Let S he the set of ell strings over some alphabet. 

If we take function L as length of the string, denoted by l(x), then 
we can define an order relation Qon S by * for x,y C S, x Cy if and 
only if length (x) ^ length (y). 
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So 1 1»xgeg!iMiifa!^Qiatr’--9iBiS pieserves the older relation C. 

Consider the following recursive program which spends string x to y. 
P(x,y)<^ ^ X s= A then y else head(x) * P(tail(x) ,y) • 
v/hore A denotes the null string. 

Now 1 (a) » 0 and for x j^A» l(head(x)) = 1 and l(tail(x)) = l(x)-1. 
So equivalent recursive program is (in view of time complexity) 

G (l(x),l(y))4ilf l(x) > 0 then G(l(x)-1, l(y)) else l(y). 
Cy(P5)(3c,y) - Cj(G^)(l(x), l(y)) 

= 0(l(x)). 



CHiTTSR 5 
CONCLUSION 

We have hriofly presented basic ideas in The Fixpoint Theory of 
computation. Then, we tried to relate arguments concerning complexity 
to the structural specification of a rudimentary language. From the 
latter effort, in retrospect, it seems that the simplest way to treat 
Iterative and recursive programs is to synthesize two programs fynm 
them, one which pertains to the gross control structure of the program 
ond the other that encapsulates the work that is repeatedly carried 
out* Elf footing such a ^n the sis is a non-trivial task, comparable in 
nature to the discovery of an invariant assertion in the Inductive Assertion 
Method of proving properties of programs (Manna 74)* Once such a break- 
down of the original program is achieved, we can then study the two 
subparts separately » from the control structure, we try to arrive at a 
counting function that allows the assessment of number of iterations; 
the repeated aoticai in the original program is recursively studied with 
xospeot to its atructirce. 

With regard to the control structure study, it seems as thoi^h the 
most important aspect here is the ordering on the data domain that the 
program manipulates# The discovery of this ordering is a challenge 
comparable to the discovery of a well-formed set and its relationship 
with a program in proofs concerning termination of pregram. 

Our application of these ideas to programs has been restricted 
to very simple programs wherein the clarity of analysis has been 
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easily lioalisQcl. Ejctending it to complex piogxans, i.e., •with compleK 
data domains, oadorings and controlling predicates, is a taste leyond 
the scope of this work. 

One satisfaction we have is the separation of concerns that arises 
from the study of complexity of iterative programs: the control structure 
has been abstr acted out of program and is than ’composed' with the body 
of tho loop# This separation of concerns is consistent with Backus'' (78) 
orti'qua,o of prograoming languages and his plea for functional languages. 

Tho onlyoptlKtare can make is with regard to the idea that we should 
formalize the structure of proofs of complexity by dealing with this 
problem as the level of progcacniing language specification. 

is only too clear, much work needs to be done before a systematic 
structure for proofs of complexity can be given fcaamally* 
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